AustralieFrV1, Main, Exploration, bibRecord, 003F66

Semantic indexing of multimedia content using textual and visual information

Identifieur interne : 003F66 ( Main/Exploration ); précédent : 003F65; suivant : 003F67

Semantic indexing of multimedia content using textual and visual information

Auteurs : Abdesalam Amrane [Algérie] ; Hakima Mellah [Algérie] ; Rachid Aliradi [Algérie] ; Youssef Amghar [France]

Source :

International journal of advanced media and communication [ 1462-4613 ] ; 2014.

RBID : Pascal:15-0028757

Descripteurs français

Pascal (Inist)
- Indexation, Multimédia, Donnée textuelle, Information visuelle, Base donnée multimédia, Recherche information, Texte, Gestion contenu, Interrogation base donnée, Linguistique, Ontologie, Traitement image, Sémantique, Mot clé, Lexique, Analyse conceptuelle, Annotation, Classification à vaste marge, Représentation parcimonieuse, Capteur multiple, Analyse sémantique, ., Recherche par contenu, Classification image, Appariement image.
Wicri :
- topic : Multimédia, Linguistique.

English descriptors

KwdEn :
- Annotation, Conceptual analysis, Content management, Content-based retrieval, Database query, Image classification, Image matching, Image processing, Indexing, Information retrieval, Keyword, Lexicon, Linguistics, Multimedia, Multimedia databases, Multisensor, Ontology, Semantic analysis, Semantics, Sparse representation, Text, Textual data, Vector support machine, Visual information.

Abstract

The challenge in multimedia information retrieval remains in the indexing process, an active search area. There are three fundamental techniques for indexing multimedia content: using textual information, using low-level information and combining different information extracted from multimedia. Each approach has its advantages and disadvantages as well to improve multimedia retrieval systems. The recent works are oriented towards multimodal approaches. In this paper, we propose an approach that combines the surrounding text with the information extracted from the visual content of multimedia and represented in the same repository in order to allow querying multimedia content based on keywords or concepts. Each word contained in queries or in description of multimedia is disambiguated using the WordNet ontology in order to define its semantic concept. Support vector machines (SVMs) are used for image classification in one of the defined semantic concept based on SIFT (scale invariant feature transform) descriptors.

Affiliations:

Links toward previous steps (curation, corpus...)

to stream PascalFrancis, to step Corpus: 000059
to stream PascalFrancis, to step Curation: 005D94
to stream PascalFrancis, to step Checkpoint: 000098
to stream Main, to step Merge: 004022
to stream Main, to step Curation: 003F66

Le document en format XML

<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en" level="a">Semantic indexing of multimedia content using textual and visual information</title>
<author><name sortKey="Amrane, Abdesalam" sort="Amrane, Abdesalam" uniqKey="Amrane A" first="Abdesalam" last="Amrane">Abdesalam Amrane</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Mellah, Hakima" sort="Mellah, Hakima" uniqKey="Mellah H" first="Hakima" last="Mellah">Hakima Mellah</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Aliradi, Rachid" sort="Aliradi, Rachid" uniqKey="Aliradi R" first="Rachid" last="Aliradi">Rachid Aliradi</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Amghar, Youssef" sort="Amghar, Youssef" uniqKey="Amghar Y" first="Youssef" last="Amghar">Youssef Amghar</name>
<affiliation wicri:level="3"><inist:fA14 i1="02"><s1>University of Lyon, CNRS, INSA-Lyon, LIRIS</s1>
<s2>UMR5205, 69621</s2>
<s3>FRA</s3>
<sZ>4 aut.</sZ>
</inist:fA14>
<country>France</country>
<placeName><region type="region" nuts="2">Auvergne-Rhône-Alpes</region>
<region type="old region" nuts="2">Rhône-Alpes</region>
</placeName>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">INIST</idno>
<idno type="inist">15-0028757</idno>
<date when="2014">2014</date>
<idno type="stanalyst">PASCAL 15-0028757 INIST</idno>
<idno type="RBID">Pascal:15-0028757</idno>
<idno type="wicri:Area/PascalFrancis/Corpus">000059</idno>
<idno type="wicri:Area/PascalFrancis/Curation">005D94</idno>
<idno type="wicri:Area/PascalFrancis/Checkpoint">000098</idno>
<idno type="wicri:explorRef" wicri:stream="PascalFrancis" wicri:step="Checkpoint">000098</idno>
<idno type="wicri:doubleKey">1462-4613:2014:Amrane A:semantic:indexing:of</idno>
<idno type="wicri:Area/Main/Merge">004022</idno>
<idno type="wicri:Area/Main/Curation">003F66</idno>
<idno type="wicri:Area/Main/Exploration">003F66</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en" level="a">Semantic indexing of multimedia content using textual and visual information</title>
<author><name sortKey="Amrane, Abdesalam" sort="Amrane, Abdesalam" uniqKey="Amrane A" first="Abdesalam" last="Amrane">Abdesalam Amrane</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Mellah, Hakima" sort="Mellah, Hakima" uniqKey="Mellah H" first="Hakima" last="Mellah">Hakima Mellah</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Aliradi, Rachid" sort="Aliradi, Rachid" uniqKey="Aliradi R" first="Rachid" last="Aliradi">Rachid Aliradi</name>
<affiliation wicri:level="3"><inist:fA14 i1="01"><s1>Research Center on Scientific and Technical Information (CERIST)</s1>
<s2>Ben Aknoun, Algiers</s2>
<s3>DZA</s3>
<sZ>1 aut.</sZ>
<sZ>2 aut.</sZ>
<sZ>3 aut.</sZ>
</inist:fA14>
<country>Algérie</country>
<placeName><settlement type="city">Alger</settlement>
<region nuts="2">Wilaya d'Alger</region>
</placeName>
</affiliation>
</author>
<author><name sortKey="Amghar, Youssef" sort="Amghar, Youssef" uniqKey="Amghar Y" first="Youssef" last="Amghar">Youssef Amghar</name>
<affiliation wicri:level="3"><inist:fA14 i1="02"><s1>University of Lyon, CNRS, INSA-Lyon, LIRIS</s1>
<s2>UMR5205, 69621</s2>
<s3>FRA</s3>
<sZ>4 aut.</sZ>
</inist:fA14>
<country>France</country>
<placeName><region type="region" nuts="2">Auvergne-Rhône-Alpes</region>
<region type="old region" nuts="2">Rhône-Alpes</region>
</placeName>
</affiliation>
</author>
</analytic>
<series><title level="j" type="main">International journal of advanced media and communication</title>
<idno type="ISSN">1462-4613</idno>
<imprint><date when="2014">2014</date>
</imprint>
</series>
</biblStruct>
</sourceDesc>
<seriesStmt><title level="j" type="main">International journal of advanced media and communication</title>
<idno type="ISSN">1462-4613</idno>
</seriesStmt>
</fileDesc>
<profileDesc><textClass><keywords scheme="KwdEn" xml:lang="en"><term>Annotation</term>
<term>Conceptual analysis</term>
<term>Content management</term>
<term>Content-based retrieval</term>
<term>Database query</term>
<term>Image classification</term>
<term>Image matching</term>
<term>Image processing</term>
<term>Indexing</term>
<term>Information retrieval</term>
<term>Keyword</term>
<term>Lexicon</term>
<term>Linguistics</term>
<term>Multimedia</term>
<term>Multimedia databases</term>
<term>Multisensor</term>
<term>Ontology</term>
<term>Semantic analysis</term>
<term>Semantics</term>
<term>Sparse representation</term>
<term>Text</term>
<term>Textual data</term>
<term>Vector support machine</term>
<term>Visual information</term>
</keywords>
<keywords scheme="Pascal" xml:lang="fr"><term>Indexation</term>
<term>Multimédia</term>
<term>Donnée textuelle</term>
<term>Information visuelle</term>
<term>Base donnée multimédia</term>
<term>Recherche information</term>
<term>Texte</term>
<term>Gestion contenu</term>
<term>Interrogation base donnée</term>
<term>Linguistique</term>
<term>Ontologie</term>
<term>Traitement image</term>
<term>Sémantique</term>
<term>Mot clé</term>
<term>Lexique</term>
<term>Analyse conceptuelle</term>
<term>Annotation</term>
<term>Classification à vaste marge</term>
<term>Représentation parcimonieuse</term>
<term>Capteur multiple</term>
<term>Analyse sémantique</term>
<term>.</term>
<term>Recherche par contenu</term>
<term>Classification image</term>
<term>Appariement image</term>
</keywords>
<keywords scheme="Wicri" type="topic" xml:lang="fr"><term>Multimédia</term>
<term>Linguistique</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">The challenge in multimedia information retrieval remains in the indexing process, an active search area. There are three fundamental techniques for indexing multimedia content: using textual information, using low-level information and combining different information extracted from multimedia. Each approach has its advantages and disadvantages as well to improve multimedia retrieval systems. The recent works are oriented towards multimodal approaches. In this paper, we propose an approach that combines the surrounding text with the information extracted from the visual content of multimedia and represented in the same repository in order to allow querying multimedia content based on keywords or concepts. Each word contained in queries or in description of multimedia is disambiguated using the WordNet ontology in order to define its semantic concept. Support vector machines (SVMs) are used for image classification in one of the defined semantic concept based on SIFT (scale invariant feature transform) descriptors.</div>
</front>
</TEI>
<affiliations><list><country><li>Algérie</li>
<li>France</li>
</country>
<region><li>Auvergne-Rhône-Alpes</li>
<li>Rhône-Alpes</li>
<li>Wilaya d'Alger</li>
</region>
<settlement><li>Alger</li>
</settlement>
</list>
<tree><country name="Algérie"><region name="Wilaya d'Alger"><name sortKey="Amrane, Abdesalam" sort="Amrane, Abdesalam" uniqKey="Amrane A" first="Abdesalam" last="Amrane">Abdesalam Amrane</name>
</region>
<name sortKey="Aliradi, Rachid" sort="Aliradi, Rachid" uniqKey="Aliradi R" first="Rachid" last="Aliradi">Rachid Aliradi</name>
<name sortKey="Mellah, Hakima" sort="Mellah, Hakima" uniqKey="Mellah H" first="Hakima" last="Mellah">Hakima Mellah</name>
</country>
<country name="France"><region name="Auvergne-Rhône-Alpes"><name sortKey="Amghar, Youssef" sort="Amghar, Youssef" uniqKey="Amghar Y" first="Youssef" last="Amghar">Youssef Amghar</name>
</region>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Main/Exploration

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 003F66 | SxmlIndent | more

HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 003F66 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Asie
   |area=    AustralieFrV1
   |flux=    Main
   |étape=   Exploration
   |type=    RBID
   |clé=     Pascal:15-0028757
   |texte=   Semantic indexing of multimedia content using textual and visual information
}}

This area was generated with Dilib version V0.6.33.
Data generation: Tue Dec 5 10:43:12 2017. Site generation: Tue Mar 5 14:07:20 2024

	Serveur d'exploration sur les relations entre la France et l'Australie
	Attention, ce site est en cours de développement ! Attention, site généré par des moyens informatiques à partir de corpus bruts. Les informations ne sont donc pas validées.

Serveur d'exploration sur les relations entre la France et l'Australie

Semantic indexing of multimedia content using textual and visual information

Semantic indexing of multimedia content using textual and visual information

Source :

Descripteurs français

English descriptors

Abstract

Links toward previous steps (curation, corpus...)

Le document en format XML

Pour manipuler ce document sous Unix (Dilib)

Pour mettre un lien sur cette page dans le réseau Wicri